Improving rejection with semantic slot-based confidence scores
نویسنده
چکیده
This paper introduces a new confidence scoring mechanism which takes advantage of the semantic parsing provided by a natural language understanding system. As a result, different segments of the user input which fill individual semantic slots are identified and individual semantic slot confidence scores are generated. With slot-based confidence scores, each individual slot receives a confidence score generated by combining the confidence scores of the individual words which fill that particular slot. With judicious use of confidence scores for individual slots, better rejection and more natural interaction with the system are achieved.
منابع مشابه
Robust semantic confidence scoring
This paper describes an approach for defining robust, application-independent confidence measures for dialogue systems. A concept-level confidence score is computed using a Multi-Layer Perceptron (MLP) classifier trained to discriminate between correct and incorrect concepts. Three types of concept-level confidence features are considered: features based on the confidence score of the underlyin...
متن کاملConfidence Scoring for Speech Understanding Systems1
This research investigates the use of utterance-level features for confidence scoring. Confidence scores are used to accept or reject user utterances in our conversational weather information system [10]. We have developed an automatic labeling algorithm based on a semantic frame comparison between recognized and transcribed orthographies. We explore recognition-based features along with semant...
متن کاملLearning semantic hierarchy with distributed representations for unsupervised spoken language understanding
We study the problem of unsupervised ontology learning for semantic understanding in spoken dialogue systems, in particular, learning the hierarchical semantic structure from the data. Given unlabelled conversations, we augment a frame-semantic based unsupervised slot induction approach with hierarchical agglomerative clustering to merge topically-related slots (e.g., both slots “direction” and...
متن کاملبهبود کارایی سیستم کاوشگر کلمات تلفنی با استفاده از نرمالیزاسیون امتیاز اطمینان مبتنی بر روش برنامهریزی خطی
Conventional word spotting systems determine hypothesized keywords and their confidence score using a speech recognizer. Acceptance or rejection of these keywords is intended based on comparison of their scores with a specific threshold. It has been proved that confidence score prepared by recognizer is highly dependent on sub-word structure of each keyword. So comparing assigned scores to keyw...
متن کاملImproving performance of an HMM-based ASR system by using monophone-level normalized confidence measure
In this paper, we propose a novel confidence scoring method that is applied to N-best hypotheses output from an HMM-based classifier. In the first pass of the proposed method, the HMM-based classifier with monophone models outputs N-best hypotheses (word candidates) and boundaries of all the monophones in the hypotheses. In the second pass, an SM (Sub-space Method)-based verifier tests the hypo...
متن کامل